Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check for and update outdated integrations #4694

Open
wants to merge 55 commits into
base: master
Choose a base branch
from

Conversation

crysmags
Copy link
Collaborator

What does this PR do?

This PR is a continuation of @bengl PR check for outdated integrations. This will check for the latest versions of the integrations and update them in a JSON file called latest.json, if any versions have been updated a PR will then be created in the event there is not a current branch or PR.

@crysmags crysmags requested review from a team as code owners September 17, 2024 17:11
@@ -0,0 +1,15 @@
name: Outdated Integrations

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟠 Code Vulnerability

No explicit permissions set for at the workflow level (...read more)

Check the permissions granted to jobs

Datadog’s GitHub organization defines default permissions for the GITHUB_TOKEN to be restricted (contents:read, metadata:read and packages:read).

Your repository may require different setup, but please consider defining permissions for each job following the least privilege principle to restrict the impact of a possible compromission.

You can find the list of all possible permissions in Workflow syntax for GitHub Actions - GitHub Docs. Please note they can be defined at the job or the workflow level.

View in Datadog  Leave us feedback  Documentation

outdated-integrations:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟠 Code Vulnerability

Workflow depends on a GitHub actions pinned by tag (...read more)

Pin third party actions by hash, or at least by tag for trusted sources

When using a third party action, one needs to provide its GitHub path (owner/project) and can eventually pin it to a git ref (a branch name, a git tag, or a commit hash).

No pinned git ref means the action will use the latest commit of the default branch each time it runs, eventually running newer versions of the code that were not audited by Datadog. Specifying a git tag is better, but since they are not immutable, using a full length hash is recommended to make sure the action content is actually frozen to some reviewed state.

Be careful however, as even pinning an action by hash can be circumvented by attackers still. For instance, if an action relies on a Docker image which is itself not pinned to a digest, it becomes possible to alter its behaviour through the Docker image without actually changing its hash. You can learn more about this kind of attacks in Unpinnable Actions: How Malicious Code Can Sneak into Your GitHub Actions Workflows. Pinning actions by hash is still a good first line of defense against supply chain attacks.

Additionally, pinning by hash or tag means the action won’t benefit from newer version updates if any, including eventual security patches. Make sure to regularly check if newer versions for an action you use are available. For actions coming from a very trustworthy source, it can make sense to use a laxer pinning policy to benefit from updates as soon as possible.

View in Datadog  Leave us feedback  Documentation

@@ -0,0 +1,15 @@
name: Outdated Integrations

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟠 Code Vulnerability

No explicit permissions set for at the workflow level (...read more)

Check the permissions granted to jobs

Datadog’s GitHub organization defines default permissions for the GITHUB_TOKEN to be restricted (contents:read, metadata:read and packages:read).

Your repository may require different setup, but please consider defining permissions for each job following the least privilege principle to restrict the impact of a possible compromission.

You can find the list of all possible permissions in Workflow syntax for GitHub Actions - GitHub Docs. Please note they can be defined at the job or the workflow level.

View in Datadog  Leave us feedback  Documentation

outdated-integrations:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟠 Code Vulnerability

Workflow depends on a GitHub actions pinned by tag (...read more)

Pin third party actions by hash, or at least by tag for trusted sources

When using a third party action, one needs to provide its GitHub path (owner/project) and can eventually pin it to a git ref (a branch name, a git tag, or a commit hash).

No pinned git ref means the action will use the latest commit of the default branch each time it runs, eventually running newer versions of the code that were not audited by Datadog. Specifying a git tag is better, but since they are not immutable, using a full length hash is recommended to make sure the action content is actually frozen to some reviewed state.

Be careful however, as even pinning an action by hash can be circumvented by attackers still. For instance, if an action relies on a Docker image which is itself not pinned to a digest, it becomes possible to alter its behaviour through the Docker image without actually changing its hash. You can learn more about this kind of attacks in Unpinnable Actions: How Malicious Code Can Sneak into Your GitHub Actions Workflows. Pinning actions by hash is still a good first line of defense against supply chain attacks.

Additionally, pinning by hash or tag means the action won’t benefit from newer version updates if any, including eventual security patches. Make sure to regularly check if newer versions for an action you use are available. For actions coming from a very trustworthy source, it can make sense to use a laxer pinning policy to benefit from updates as soon as possible.

View in Datadog  Leave us feedback  Documentation

Copy link

github-actions bot commented Sep 17, 2024

Overall package size

Self size: 7.63 MB
Deduped: 62.94 MB
No deduping: 63.28 MB

Dependency sizes | name | version | self size | total size | |------|---------|-----------|------------| | @datadog/native-appsec | 8.2.1 | 19.18 MB | 19.19 MB | | @datadog/native-iast-taint-tracking | 3.1.0 | 12.27 MB | 12.28 MB | | @datadog/pprof | 5.3.0 | 9.85 MB | 10.22 MB | | protobufjs | 7.2.5 | 2.77 MB | 5.16 MB | | @datadog/native-iast-rewriter | 2.5.0 | 2.51 MB | 2.65 MB | | @opentelemetry/core | 1.14.0 | 872.87 kB | 1.47 MB | | @datadog/native-metrics | 2.0.0 | 898.77 kB | 1.3 MB | | @opentelemetry/api | 1.8.0 | 1.21 MB | 1.21 MB | | import-in-the-middle | 1.11.2 | 112.74 kB | 826.22 kB | | msgpack-lite | 0.1.26 | 201.16 kB | 281.59 kB | | opentracing | 0.14.7 | 194.81 kB | 194.81 kB | | lru-cache | 7.18.3 | 133.92 kB | 133.92 kB | | pprof-format | 2.1.0 | 111.69 kB | 111.69 kB | | @datadog/sketches-js | 2.1.0 | 109.9 kB | 109.9 kB | | semver | 7.6.3 | 95.82 kB | 95.82 kB | | lodash.sortby | 4.7.0 | 75.76 kB | 75.76 kB | | ignore | 5.3.1 | 51.46 kB | 51.46 kB | | int64-buffer | 0.1.10 | 49.18 kB | 49.18 kB | | shell-quote | 1.8.1 | 44.96 kB | 44.96 kB | | istanbul-lib-coverage | 3.2.0 | 29.34 kB | 29.34 kB | | rfdc | 1.3.1 | 25.21 kB | 25.21 kB | | tlhunter-sorted-set | 0.1.0 | 24.94 kB | 24.94 kB | | limiter | 1.1.5 | 23.17 kB | 23.17 kB | | dc-polyfill | 0.1.4 | 23.1 kB | 23.1 kB | | retry | 0.13.1 | 18.85 kB | 18.85 kB | | jest-docblock | 29.7.0 | 8.99 kB | 12.76 kB | | crypto-randomuuid | 1.0.0 | 11.18 kB | 11.18 kB | | koalas | 1.0.2 | 6.47 kB | 6.47 kB | | path-to-regexp | 0.1.10 | 6.38 kB | 6.38 kB | | module-details-from-path | 1.0.3 | 4.47 kB | 4.47 kB |

🤖 This report was automatically generated by heaviest-objects-in-the-universe

@pr-commenter
Copy link

pr-commenter bot commented Sep 19, 2024

Benchmarks

Benchmark execution time: 2024-10-22 21:24:24

Comparing candidate commit e4fa8ab in PR branch crysmags/outdated-integrations with baseline commit 15ab272 in branch master.

Found 22 performance improvements and 0 performance regressions! Performance is the same for 235 metrics, 9 unstable metrics.

scenario:appsec-iast-no-vulnerability-control-18

  • 🟩 cpu_user_time [-111.877ms; -87.546ms] or [-18.676%; -14.614%]
  • 🟩 execution_time [-141.688ms; -102.835ms] or [-17.556%; -12.742%]
  • 🟩 instructions [-192.4M instructions; -190.8M instructions] or [-13.080%; -12.969%]
  • 🟩 max_rss_usage [-6.805MB; -6.236MB] or [-8.184%; -7.500%]

scenario:appsec-iast-no-vulnerability-iast-enabled-always-active-18

  • 🟩 cpu_user_time [-157.114ms; -122.682ms] or [-11.913%; -9.303%]
  • 🟩 execution_time [-168.284ms; -83.516ms] or [-11.063%; -5.490%]
  • 🟩 instructions [-221.2M instructions; -207.4M instructions] or [-8.450%; -7.924%]

scenario:appsec-iast-no-vulnerability-iast-enabled-default-config-18

  • 🟩 cpu_user_time [-135.957ms; -104.517ms] or [-10.692%; -8.220%]
  • 🟩 execution_time [-157.459ms; -99.983ms] or [-10.702%; -6.795%]
  • 🟩 instructions [-213.0M instructions; -194.7M instructions] or [-8.699%; -7.953%]

scenario:appsec-iast-with-vulnerability-control-18

  • 🟩 cpu_user_time [-124.716ms; -88.664ms] or [-13.036%; -9.268%]
  • 🟩 execution_time [-177.572ms; -108.233ms] or [-12.104%; -7.378%]
  • 🟩 instructions [-228.0M instructions; -216.3M instructions] or [-9.042%; -8.577%]

scenario:appsec-iast-with-vulnerability-iast-enabled-always-active-18

  • 🟩 cpu_user_time [-156.534ms; -101.191ms] or [-8.640%; -5.585%]
  • 🟩 instructions [-308.8M instructions; -279.2M instructions] or [-7.124%; -6.441%]

scenario:appsec-iast-with-vulnerability-iast-enabled-default-config-18

  • 🟩 cpu_user_time [-165.733ms; -109.647ms] or [-9.800%; -6.484%]
  • 🟩 execution_time [-289.081ms; -141.054ms] or [-11.689%; -5.703%]
  • 🟩 instructions [-295.9M instructions; -243.9M instructions] or [-7.602%; -6.265%]

scenario:plugin-q-with-tracer-18

  • 🟩 cpu_user_time [-135.274ms; -118.116ms] or [-14.581%; -12.731%]
  • 🟩 execution_time [-139.819ms; -126.881ms] or [-13.568%; -12.313%]
  • 🟩 instructions [-208.1M instructions; -196.5M instructions] or [-11.771%; -11.113%]
  • 🟩 max_rss_usage [-8.426MB; -8.011MB] or [-5.549%; -5.276%]

@crysmags crysmags force-pushed the crysmags/outdated-integrations branch from 7dcfe1a to f232598 Compare September 23, 2024 21:55
@DataDog DataDog deleted a comment from datadog-datadog-prod-us1 bot Sep 24, 2024
@crysmags crysmags force-pushed the crysmags/outdated-integrations branch from 686b046 to 7b7f9b2 Compare September 27, 2024 21:50
Copy link

codecov bot commented Sep 30, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 62.88%. Comparing base (bb0bbcc) to head (f258d81).
Report is 11 commits behind head on master.

Additional details and impacted files
@@             Coverage Diff             @@
##           master    #4694       +/-   ##
===========================================
- Coverage   91.42%   62.88%   -28.54%     
===========================================
  Files         112      130       +18     
  Lines        3475     4567     +1092     
  Branches       33       33               
===========================================
- Hits         3177     2872      -305     
- Misses        298     1695     +1397     
Flag Coverage Δ
62.88% <ø> (-28.54%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@crysmags crysmags force-pushed the crysmags/outdated-integrations branch 3 times, most recently from 8e81416 to d336692 Compare October 2, 2024 16:08
@crysmags crysmags force-pushed the crysmags/outdated-integrations branch from 1ccb6a1 to e4fa8ab Compare October 22, 2024 21:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants